Fluctuation relations for a driven Brownian particle 
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\^ , We consider a driven Brownian particle, subject to both conservative and non-conservative applied forces, 

' whose probability evolves according to the Kramers equation. We derive a general fluctuation relation, express- 

' ing the ratio of the probability of a given Brownian path in phase space with that of the time-reversed path, in 

, terms of the entropy flux to the heat reservoir. This fluctuation relation implies those of Seifert, Jarzynski and 

f— I ■ Gallavotti-Cohen in different special cases. 
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Fluctuation relations of increasinggenerality have been derived in the recent years, starting from the Evans-Searles relation [|l]] 
and the Gallavotti-Cohen theorem [g], via the Jarzynski equality [|]], the Hatano-Sasa relation [^, to arrive at the recent and 
^ rather general Seifert relation [|[], from which the previous identities can be derived by simple manipulations. These results have 

C/3 ' been obtained by considering situations of increasing generality, and it appears that a sufficient condition for fluctuation relations 
to hold is the existence of mechanical equilibrium at each instant of time [^. However, this condition is not necessary, as shown 
by the derivation by Kurchan of some fluctuation relations for a Brownian particle with inertia. 

We wish to point out that it is possible to obtain a compact derivation of the fluctuation relations by deriving a key relation 
between the probability of a path in phase space and that of its time-reversed image, for a particle with inertia. This relation 
^ encompasses the relation derived by Crooks [||] for a particle subject to conservative forces and extended by Seifert [^] to 
Q arbitrary forces in the overdamped regime. Our derivation is inspired by Kurchan's one [Q], but is made more compact and more 
O general by considering the generating functional of the conditional probabilities for the paths. 

As a bonus, we obtain an explicit expression for the entropy production and the heat flow for a Brownian particle with inertia, 
which generalizes the expression introduced by Sekimoto [^], valid in the overdamped regime. 
J> The key relation between the probability of a path o), conditioned on its initial point, and that of the reverse path w, conditioned 

\!^ on its initial point, is derived in sec. [|. The relation involves a functional of the path, whose physical interpretation as the entropy 
flow into the heat bath is given in sec. In sec. using the formalism previously introduced, the explicit expression of path 
probability as a form of the Onsager-Machlup functional is recovered, and the fluctuation relation is shown to hold for such a 
functional. A brief discussion follows, while the derivation of the relation between the time derivatives of "global" and "local" 
entropies is given in the Appendix. 

o 

^ ■ II. A GENERALIZED CROOKS IDENTITY 

We consider a particle in d dimensions, whose evolution is described by the Langevin equation 
O. mf = -Cr + f^+T](t), (1) 



where is a time-dependent parameter, and is a non conservative force. We assume that rjit) is a delta-correlated white noise 
• with variance 2(T. Boltzmann's constant is set equal to 1 throughout. 
, We denote by jc = (p, r) the microstate, and by P(x, t) the probability distribution function (pdf) of the process (|l]) in phase 
■ space. This function evolves according to the differential equation 

dP{x, t) 

—^^£^^,)P(x,t), (2) 
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where X.^ is the Kramers operator 

dr \ m I dp \m dr '/ " dp 
Let us define the time-reversal operator I by 

lip, r) = i-p, r), 

and the associated operator Q, by 

We assume that the system energy, defined by 



d 2 



i=i 



is invariant under time inversion: 



E(Ix,t) = E(x,t). 

The microscopic reversibility of the process (|l]) implies the following relation 

n-i r n - r\ , ff'V) P 

In the following the symbol a> will indicate an arbitrary path in the system phase space: 

w : f — » x(t). 



(3) 



(4) 



(5) 



(6) 



(7) 



(8) 



(9) 



For any arbitrary function a{x, t), and any arbitrary path w in the system phase space we define the quantity A{t, to, u) as the 
integral of a(x, f) over the interval [fo, f] along the given path w: 



= r df' 

J to 



A{t, to, w) = df' a(x{t'), t'). 



The joint probability distribution function (^(x,A, t) evolves according to the dififerential equation 

-^Z,,,<^-aix,t)-. 



(10) 



(11) 



Let us define the function 



^'(x, t; xo, to; ii,a) - I Dcd 'PiuS) I dAb(A- A(t, to, co)) e 

Jx(;n)=.Vo J 



■i('o)=-Vo 

= ^ AAe^(^{x,A,t), 



A(t,to.ii>) 



(12) 



where we make explicit the fact that *P depends on the initial condition xo, to, and is a functional of //(f) and a{x, f). Then *!* 
satisfies the following equation: 



5*P 

— =X^(,)*P + fl(x,f)>P. 



(13) 



A number of fluctuation relations can be easily derived from this expression. To illustrate this point, we report here the 
derivation of the Hatano-Sasa relation IMl. Let 



p^^(x,^i)^Q-1'^-''|'^ 

be the steady-state distribution function associated to the operator X^, which satisfies 

£^P^^{x,^i) = 0. 



(14) 



(15) 
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Let us choose the arbitrary function a(x, t) as follows: 



a\x,t) = IJiit)— = -nit) 



so that eq. (nO) reads 



A = - I dt'fi(t')^ 
on 



x(t'),n(t') 



Using the definition of ^P, eq. (|2|), one finds 

((5(jc - x(f)) e-^W) = J"dAe'^<E)(jc,A,f) = *I'(x,f;xo,fo;yu,a*). 
But is solution of eq. (Ob, which for the particular choice a - a* takes the form 



d'V dd) 



(16) 



(17) 



(18) 



(19) 



The solution of this last equation, satisfying the initial condition ^{x, to) - P^^(x,iJ.{to)), is = e '/'^■''f'^'^^ - P^^(x,fi{t)), and thus 
eq. ( p^ becomes 



(5(x - x(t)) e"*®) = P^^(x,n(t)), 



(20) 



which is the Hatano-Sasa identity, and reduces to the Jarzynski equality when the non-conservative force vanishes throughout. 
Now, let the functional ^{x, t; xq, Iq; ju, a) be defined by 



"Vix, t; xo, fo;jU, a) = Q^^'Vix, t; xo, to^,^l, a) Q,„. 
One can easily check that ^ satisfies the evolution equation 



dt 



1 dE P ^ ,^ 

1 ■ 1- a(Jx, t) 

T dt T m 



Using equations and ([l^, we obtain the following equality 

^(Ix, f; Ixo, to; n, a) = ^'^'^(^''^-EMmy^f^^^ ^. 
Furthermore, upon integration of eq. (^2[), we obtain 

Y(Jx, f; Ixq, to; ji, a) - *!*( Jxq, t; Jx, fo; jl,a + w), 

where we have defined, Vf' e [fo, f], 

f' = f - it' - to); 

m = ^l(r); 

a(x, t') - a(Ix, 7); 



w(x,f) = J 



dE p 

+ Jtl(t) ■ — 
at m 



Thus, substituting eq. ( p3| ) into eq. ( ^4) ) we obtain 

^(x, /; xo, fo; a) = >P(Jxo, f; Jx, fo; /i, a + w) e-l^(-^''>-^(-'»''»)l/^. 

We choose a(x, t) as 

fl(x, f) = i(f)x = X^P\t) ■ p + X^'\t) ■ r. 
Then, using the definition of *P, eq. ([l2|), we obtain the generating functional for the path probabilities 



^'(x, f ; Xo, fo; yu, i x) = I P{a)) exp 

Jx(;o)=xo 



r df' i(f')x(f') 

^'0 



(21) 



(22) 



(23) 



(24) 



(25) 
(26) 
(27) 

(28) 



(29) 



(30) 



(31) 
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Now, for each path w, starting from xq and finishing in x, the following equality holds 



f / dE dE 
E{x,t) - E(xqJq) ^ J ^— df'+ — 



djc(f') 



(32) 



In this expression, the integral has to be interpreted according to Stratonovich, otherwise additional terms would appear The 
relation ( pl| ) holds for arbitrary A, and thus leads to an analogous relation for the probabilities of the paths cj conditional on their 
initial points. Indeed, given the path co defined by we formally have 



,/i|xo,f()) = J" 



^{x, t; XQ,t(,; n. Ax), 



(33) 



where we have introduced the functional integration over A from -ioo to +ioo. Applying this operation to eqs. ( |29[ ) and (^jj) we 
obtain the central result 



'P(w,/^|jco,fo) = !P(w,ju|Jjc,fo) exp 



where 



dE 

AQi(t) = - — 
ox 



dx(f) + /^(,) ■ — df. 
40 m 



(34) 



(35) 



Thus Crooks's and Seifert's identities ([|[ eq. (13)], [^, eq. (14)]) hold also in the case in which the Brownian particle is subject 
to conservative and nonconservative forces, which do not necessarily equilibrate mechanically with the friction force at each 
instant in time. Note that the expression of dQ2 must be supplemented by its interpretation as a Stratonovich differential. 

Seifert [||] has taught us how to derive the relevant fluctuation relations from the identity (|34|), by introducing carefully chosen 
"initial" and "final" pdf's pq{xq), pi(Ix). For example, let po(-^o) be an arbitrary normalized initial condition at time t^, and 
p\(x) be the corresponding evolved pdf at time f, and define 



+ ln 



Pl(x) ' 



Then 



{6(x- x(t))e-'^) = JdxQ J DuP{(D,il\Ix,tQ)px(x) ^ px{x). 



(36) 



(37) 



This result can be obtained by changing the integral over w into an integral over o) and by exploiting the normalization of the 
conditional probability of the evolution from Ix to Ixq over the final state Ixq. Then one can interpret R as the total entropy 
change, being the sum between the entropy given to the heat bath and the entropy change of the particle, as we shall see in 
the next section. The Jarzynski equality also follows from eq. ( |34| ) by taking for pq{xq) and p\{x) the equilibrium distributions 
corresponding to the initial and final states. If one takes instead yu as a constant, and collects together the paths oj which yield a 
given value I of / AQiJT, one obtains a "transient" form of the Gallavotti-Cohen relation: 



P(-S) 

The Gallavotti-Cohen relation follows in the limit of long times, by setting 



(38) 



(39) 



where 



2 = to-. 



(40) 



and where A(cr) (implicitly defined by eq. ( |3^ itself) is the large-deviation function for the entropy production rate. 
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III. ENTROPY PRODUCTION AND HEAT FLOW 



We provide here the physical interpretation of the quantity dQ2(t). Let us define the local entropy 

s(x,t) - - In P(x,t). 

The Shannon entropy of the system is thus given by 



S(t) = {s(x,t)} 
The time derivative of this quantity is given by 



dx P(x,t) lnP(x, t). 



dSjt) 
dt 



dP(x,t) d\nP(x,t) 
ln[P(x,t)]+P(x,t) --^ 



dt 



dP(x, t) 
dx — lnP(x,f) 
dt 



J \Tm dp I ' m \Tm dp ] 



(41) 
(42) 

(43) 
(44) 
(45) 



where the integral of the second term of eq. (p3[) vanishes because of the conservation of the pdf normaUzation. For the details 
of the calculations see the appendix, equation ( |A.1[ ). On the other hand we have 

(46) 



\ dt A(/)=.v/^ J [ \Tm dp I m \Tm dp j 

where (• • ■)^ indicates the av erage ove r the pdf P{x, t) and over the reaUzations of the process. For the details of the calculations 
see the appendix, equations (A_^- A_^). Thus we obtain the result 



dS{t) I ds(x(t),t) 



dt 



dt 



x(D=x 



Let us now define the quantity 



Ids ds \ 

dQp = dQ2 + T{—dr + —dp\ 

dx(0 + /.«-^d..r[|i.dr.|i.dp). 

m \dr dp J 



(47) 



(48) 



dE 
dx 



We have 



dQp(x(t),t) 



dt 



x(t)=x 



,p dlnP 
m dp 



dS(x,t) p Ip d\nP 
df m \m 



(49) 



dp 

The last equation indicates that the average of Q^jT is a non negative quantity, and can thus be interpreted as the entropy 
production rate of the process. Furthermore, rearranging eq. (B^ we have 



dep-de..r(^.dr..|.dp). 



Since one finds 



ds{x{t), t) 



dt 



x{l)=x 



(see appendix, eqs. (4^)-( AJ)), exploiting eq. (p7|), one ends up with 

Thus, we can interpret the quantity dQ2/T as the entropy flow into the heat reservoir. 



(50) 



(51) 



(52) 



IV. FLUCTUATION RELATIONS AND THE ONSAGER-MACHLUP FUNCTIONAL 



Following the approach outlined in [p^, and introducing the variable 7'''' conjugate to p and 7^*^' conjugate to r, we can 
express the functional ^' as 



*P(jc,f;xo,f();yu,a) = lim , , , 



I n T^r^ ^(-^ ~ -^A^) ^''^Pl y, [7k(xk - Xk-i) + (L(yk, Xk-utk-i) + a(xk-i,tk-i)) At] \ , (53) 



where 



Af = 



t-to 



N 

tk - to + k At; 
jx - 7*'''' ■ p + 7*'^'* ■ r; 



L(r,x,f) = 7W.(-^) + 7' 
In the continuum limit, equation (^s]) becomes 

"Vix 

where 



m or 



nx(t)-x 

Jx(to)=Xo 



Sly, w, a] = r df' [y(t') i(f') + L(r(f'), 4?'), + fl(:c(f'), ?')] • 

J to 



is the "action" associated to the given path oj. From eq. ([34|), taking into account eq. ([35[), we obtain 

vt(/)=jA-o 



*P(Jxo,f; Jx, fo;/i,a + w) = I I}yDaje' 



Jx(t, 



-t('o)=-to 



where 



S[y, CO, a] — S[y, a>, a] + 



T X \ dx 



X(t') - fn(t') ■ — 



(54) 

(55) 
(56) 

(57) 



(58) 



(59) 



(60) 



(61) 



The second term on the rhs of the last equation corresponds to - J' dQ2, where dQ2 is defined by eq. (^5|), along the given path 
tj. 

We can obtain an explicit expression for the probabilities of the path by performing the gaussian functional integral over y. 
By taking a(x, t) - from eq. ( p^ ) and eq. (53 ), we obtain that the probability of a given path lo is given by 



nu] = Hm 



/n 



f.ni'^k-Xk-l )+L{7k,Xt-\ ,'1-1 ) A' 

(2m) 



2d 



(62) 



If in last equation we substitute the expression for L as given by eq. (p7|), we obtain 



Pito] = lim 



/n 



+ 7 

N 



k=l 
(P) 



d7r 



{2m)d (2m)d 



exp||;[7r(An-^Af Ar^r(7rr 

{k=l 



Apk + At 



dU. 



m or 



lim f] 6 (Ark - — At) exp . [Apt + At G{pk, n, f^)] 



where 



G(pk, rk, tk) = + — 
m or 



(63) 



(64) 
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Equation ( p3| ) indicates that the probabihty of a given path is non-zero only if the path satisfies 

p - mr, (65) 

as expected. Some care has to be taken in passage to the continuum hmit in eq. (|63|): the argument of the exponential in this 
equation reads 



— + G(pk,rk,tk) 



(66) 



We consider separately the large N limit of each of the terms appearing in this sum: the first and the second term read 



(67) 



(68) 



respectively. The expression appearing on the rhs of eq. ( |67| ) is of course only formal, since the weight of the functional integral 
is concentrated on functions that are continuous but not differentiable. The double product reads 



lim (-:r^) y [{Pk - Pk-i) ■ G{pk, n, h)] = -:r^(/) f dp ■ G(p, r, t), 



(69) 



and, as discussed in ref. |]1 Ip, the value of the integral depends on the discretization scheme: we have consequently used the 
prefix (/) indicating that the integral is the continuum limit of an It5 sum. We can express this quantity in a more convenient way 
by writing, in analogy with Ito's formula (see eqs. (17)-(19) in ref. [[Til] and references therein) 



(I) dp-G(p,r,t) 



f 

J to 



G(p(t'), r(t'), t') ■ p(t')dt' -(if dt' y ^ 



(70) 



p(t'),r{t'),t' 



Thus, substituting eqs. (|7]), ( |6^ and ([70|), into eq. (|63|), in the continuum hmit eq. ( |6^ becomes 



P{a>) oc exp 



— r 



mf{t') + (r + 



dr 



fin 



r(t') 



df' + |£(f-fo) 

2m 



(71) 



These expressions correspond to those obtained by Onsager and Machlup [|T^] for the harmonically bound Brownian particle. 
Note that the linear term appearing in the exponential of eq. (^T]), and which arises from eq. (^^, can be "hidden" in the 
normalization of the probability function P((jd) as long as one deals with a force G linear in p. 

From eq. ([ti]), we are able to recover eq. ( ^4| ) directly. In fact, for the inverse path oj, eq. ( [7l| ) reads 



ViCS) oc exp 



--f 



mf(t') - (r(t') + 



dU, 



dr 



iJii') 



r(l') 



, 3^ 
df + (f - fo) 
2m 



(72) 



and thus we have, after straightforward manipulations. 



- exp 



Pit') 



pit') + 



fit) 



dr 



r(f') 



rdfc 



(73) 



where dQ2 is given by eq. (|3f_ 

While eq. (|7l|) is well known, we wish to emphasize the relation of the entropy flow along a given trajectory w, with the 
generahzed Onsager-Machlup functional for that trajectory, expressed by eq. ([t^. 
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V. DISCUSSION 

We have obtained a compact derivation of the relation between the probabiHty of a given path in phase space and that of its 
time-reversed image in the specular manipulation protocol. The ratio of the probabilities has been interpreted as the entropy 
flow into the heat bath, by a suitable generalization of the expression of the heat flow. Different fluctuation relations can be 
derived from this key equality by simple manipulations. The approach can be easily applied to more complex systems, and to 
situations in which the energy function is not invariant under time reversal, due, e.g., to the presence of magnetic fields. We 
have also shown how the basic relation directly follows from the expression of the path probability first established by Onsager 
and Machlup for the harmonically bound particle. We hope that the present work can be useful in the investigation of more 
and more general aspects of the nonequilibrium thermodynamics of small systems. 
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APPENDIX: DERIVATION OF THE EXPRESSIONS FOR THE TIME DERIVATIVE OF THE ENTROPY 



Let us first derive eq. (p3|). After substitution of equations and into eq. (Q), we obtain 

^^^'^ _ fdxlnpl— (--p]+ — 
J \dr \ m ' dp 



dt 



-f 



dx 



dx 



dlnP 
dr 



{--")■ 

\ m I 



d\nP 
dp 



(- + ^-f,]P + iT—P 
m or I op 

P dU, \ 8 

^i^^-f^Y^^^Tpr 



p d\\\P IdlnP 
P^- ■ — — + ^TP 



' m dp 



dp 



[dx ^rf^.^V-i^.f^.^) 

J \ Tm op I T m \m op j 



P(x, t). 



as can be checked by some manipulation. Equation ( AJ_ ) corresponds thus to eq. ([45|). 
We can now prove eq. (Sq). We have 



ds{x{f), t) 



dt 



x(t)=x 



ds(x(t), t) ds(x(t), t) ds(x(t), t) 
r H ■ p H 



dr 



dp 



dt 



(A.l) 



(A.2) 



The last term on the rhs is independent of the path, and its average vanishes because of the normalization. Thus we are left with 

' ds(x(t), t) 



l ds(x(t),t) \ ^ r 
\ dt 4,)=a7^ j 



dx P{x, t) 



ds{x,t) ds(x,t) 

[r]r, + ■ [p]n \ . 



dr 



dp 



(A.3) 



where [• ■ ■]^ is the average over the process realization alone, constrained by the final state x{t) - x. For the process described 
by eqs. (Q) and (^, one obtains 



m 



.P 



dU., 



Hence, eq. (A.3) becomes 

ds(x(t), t) 



dt 



x(l)=x 



dxP 



d\nP p ^ d\nP 



dh\P(x,t) 
dp 



dr m dp 



p dUu , d\nP 
m dr dp 



dxP- 



d\nP 



dp 



p d\nP 
C- + CT—— 
m dp 



dxP 



I p dlnP 
\ Tm dp 



m \ Tm 



p dlnP 



dp 



(A.4) 
(A.5) 



(A.6) 



which corresponds to eq. ( 46 ) 



[1] D. J. Evans and D. J. Searles, Equilibrium microstates which generate second law violating steady states, Phys. Rev. E 50, 1645 (1994). 

[2] G. Gallavotti and E.G.D. Cohen, Dynamical ensemble in a stationary state, J. Stat Phys. 80, 931 (1995). 

[3] C. Jarzynski, Nonequilibrium equality for free energy differences, Phys. Rev. Lett. 78, 2690 (1997). 

[4] T. Hatano and S. Sasa, Steady-state thermodynamics of Langevin systems, Phys. Rev. Lett. 86, 3463 (2000). 

[5] U. Seifert, Entropy production along a stochastic trajectory and an integral fluctuation theorem, Phys. Rev. Lett. 95, 040602 (2005). 

[6] This point has been emphasized in particular by R. D. Astumian, The unreasonable effectiveness of equilibrium-like theory for interpreting 

non-equilibrium experiments. Am. J. of Physics., in press. 
[7] J. Kurchan, Fluctuation theorem for stochastic dynamics, J. Phys. A: Math. Gen. 31, 3719 (1998). 
[8] G. E. Crooks, Path-ensemble averages in systems driven far from equilibrium, Phys. Rev. E 61, 2361 (2000). 

[9] K. Sekimoto, Kinetic characterization of heat bath and the energetics of thermal ratchet models, J. Phys. Soc. Japan, 66, 1234 (1996). 

[10] A. Imparato, L. Peliti, Work distribution and path integrals in general mean-field systems, Europhysics Letters 70, 740 (2005); A. 
Imparato, L. Peliti, Work-probability distribution in systems driven out of equilibrium, Phys. Rev. E 72, 0461 14 (2005). 

[11] K. L. Hunt, J. Ross, Path integral solutions of stochastic equations for nonlinear irreversible processes: The uniqueness of the thermody- 
namic Lagrangian, / Chem. Phys. 75, 976 (1981). 

[12] L. Onsager and S. Machlup, Fluctuations and irreversible processes, Phys. Rev. 91, 1505 (1952); S. Machlup and L. Onsager, Fluctuations 
and irreversible process. II. Systems with kinetic energy, Phys. Rev. 91, 1512 (1952). 



